Transition mechanism for computing system utilizing user sensing

ABSTRACT

A transition mechanism for a computing system utilizing user sensing. An embodiment of an apparatus includes a sensing element to sense a presence or movement of a user of the apparatus, a processor, wherein operation of the processor includes interpretation of user gestures to provide input to the apparatus, and a light generation element to generate a light to indicate existence of a virtual boundary of the apparatus. The computing device is to change from a first state to a second state upon the sensing element sensing that at least a portion of the user is within the virtual boundary.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a national phase of PCT/US2011/067280 filed Dec. 23,2011, which application is incorporated herein by reference in itsentirety.

TECHNICAL FIELD

Embodiments of the invention generally relate to the field of computingsystems and, more particularly, to a transition mechanism for acomputing system utilizing user sensing.

BACKGROUND

Computing systems and related systems are being developed to provide amore natural interface for users. In particular, computing systems mayinclude sensing of a user of the computing system, where user sensingmay include gesture recognition, where the system attempts to recognizeone or more gestures of a user, and in particular hand gestures of theuser.

However, conventional systems often lack the ability to discern theintention of users. Among other problems, gestures used to communicatewith a computing system also are used for many other purposes, thusmaking it difficult for the computing system to recognize when a gestureis intended.

In particular, a computing system may have difficulty in determiningwhen a user intends to make transitions with the computing system, suchas to enter into computing system operation and to exit computing systemoperation, without requiring awkward or unnatural operations by theuser. Similarly, a user may have difficulty in naturally recognizing thestatus of the computing system with regard to such transitions by theuser.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the invention are illustrated by way of example, and notby way of limitation, in the figures of the accompanying drawings inwhich like reference numerals refer to similar elements.

FIG. 1 illustrates an embodiment of a computing system including amechanism to handle transitions for a user in relation to the computingsystem;

FIG. 2 illustrates as embodiment of a laptop computer to sense usersincluding a transition mechanism;

FIG. 3 illustrates an embodiment of a computing system providing forengagement of a user using a transition mechanism;

FIG. 4 illustrates display screens generated by an embodiment of acomputing system to provide visual indications of transitions of stateof the computing system with regard to a user;

FIG. 5 is a flowchart to illustrate an embodiment of a process fortransitioning a state of a computing device to connect with a user;

FIG. 6 is a flowchart to illustrate an embodiment of a process fortransitions of a state of a computing system in connection withrecognition of gestures by a user;

FIG. 7 is a block diagram to illustrate an embodiment a computing systemincluding mechanism to handle transitions for a user in relation to thecomputing system; and

FIG. 8 illustrates an embodiment of a computing system for perceptualcomputing

DETAILED DESCRIPTION

Embodiments of the invention are generally directed to entry and exitmechanism for computing system gesture recognition.

As used herein:

“User sensing” means a computer operation to sense a user. The sensingof a user may include position and motion detection, such as a computingsystem detecting and interpreting gestures made by a user of thecomputing system as inputs to the computing system. User sensing mayutilize any technology by which the user may be sensed by the computing,including visual sensing (using one or more cameras or similar devices),sound sensing (including detection of sounds and detection of soundreflection), heat or infrared sensing, sensing and interpretation ofprojected light patterns (visible or invisible), and other technologies.User sensing may include operations of a perceptual computing system insensing user operations and intent, where a perceptual computing systemis a system allowing for the addition of alternative input modalities,including gesture recognition.

“Computing system” means any device or system that includes computingcapability. A computing system includes both a single unit, such as alaptop computer, and a system of multiple elements. A computing systemis not limited to a general-purpose computer, but also includes specialpurpose devices that include computing capability. A “computing system”includes a desktop computer, a game console, a laptop or notebookcomputer, an all-in-one (AIO) computer, a tablet computer, a handheldcomputing device including a smart phone, or other apparatus or systemhaving computing and display capability.

In a computing system framework utilizing user sensing to detect systeminputs, there are no tactile cues to tell the user that they areinterfacing with the computing system. Similarly, there are generally noconcrete cues that the computing device can use in order to confirm theuser's intent to interact with the computing device (i.e., what areintended gestures versus unintended gestures).

In some embodiments, a computing system includes a transition mechanismto detect and provide feedback regarding transitions of the user inrelation to the computing system.

In some embodiments, an intent of the user to interact with a computingsystem is determined by the motion of the user, such as by a user's handor hands, toward an element of the computing system. While embodimentsare not limited to a user's hands, this may the most common operation bythe user. In some embodiments, the element of the computing systemtowards which the user is moving is a display screen of the computingsystem, providing a natural interaction with the computing system. Insome embodiments, the intent of the user is determined when thecomputing system senses that the user (the user's hand or other element)crosses a line or plane in space, where the line may be an “imaginary”line in space, which is generally referred to herein as a “virtualboundary”. Once at least a portion of the user (such as a hand of theuser) crosses the virtual boundary, the computing device may interpretthe user's actions as intent and react accordingly. In some embodiments,the computing device may further use context awareness (based onknowledge of the context of the user's action) in order to determine anintent by the user to move towards the computing system to “enter” thespace of the computing system. Movement towards or away from thecomputing system may be referred to as motion along the Z-axis, asopposed to movement in the X-axis (horizontal or side to side inrelation to the computing system) and movement in the Y-axis (verticalor up and down in relation to the computing system).

In some embodiments, a computing system determines or establishes thelocation of a virtual boundary in space for a user. In some embodiments,the virtual boundary may be different from user to user. In someembodiments, the virtual boundary may vary by context for a single user.In some embodiments, rather than determine, for example, a singlearbitrary line at a distance from the screen, the computing device mayestablish the virtual boundary based on sensing of the user's positionand location relative to the computing system. For example, thecomputing system may monitor the position of the user's head, elbows, orshoulders, or any combination thereof, relative to the user's handsalong the Z-axis.

In some embodiments, in order to provide a psychological line or clueindicating when the user enters the computing space, an illuminated lineis provided by the computing device in order to provide feedback. Insome embodiments, the illuminated line provided by the light element isused to provide an indication of the existence of the virtual boundary,and to provide indications that the user has crossed the virtualboundary into a new interaction model. In some embodiments, the lightelement provides a light indicating a location of the virtual boundary,and in some embodiments the light may be in a different location thanthe virtual boundary, such as, for example, where there is an offsetbetween the light and the virtual boundary. In some embodiments, anilluminated line designating the virtual boundary is used to providefeedback to a user with regard to operation of the computing system.

In some embodiments, a color of the illuminated line may be used toindicate a certain status concerning the user in relation to thecomputing system. In some embodiments, the illuminated line mayilluminate as a first color (such as blue) when the user has entered thecomputing space. Further, the illuminated line may illuminate as asecond color (such as white) when the user has crossed the virtualboundary, and may be performing a gesture that corresponds to a gesturethat is contained in a gesture library that is accessible to thecomputing system, and as a third color (such as red) when the user makesa mistake (generating an error state) or resets the system to a “Home”position. Embodiments are not limited to these elements, and additionalcolors and feedback may indicate other states for a computing systemwith regard to a user.

In a particular example of a computing system being a laptop computer,the illuminated line may be generated by a lighting element in thelaptop computer, such as a light element installed in or on the laptopcomputer. In one example, the lighting element may be located running ina horizontal direction between, for example, a palm rest and a keyboardof the laptop computer.

In some embodiments, the illuminated line may be produced by other lightgenerating sources, such as a separate element of the computing system,a light installed in a work surface, or other light source. In the caseof a peripheral being used as the computing system input engine, thecomputing system may utilize lights or illuminated lines on theperipheral as the feedback mechanism. As an alternative, the peripheralmay project a line to the surface in front of it to indicate the regionwhere gestures for the computing system are recognized. This may, forexample, consist of a diode laser in conjunction with a cylindrical lensin order to generate a laser sheet. When the sheet hits the surface infront of the computing system peripheral or the hands of the user, avisual cue to the user is generated with regard to the existence orlocation of a virtual boundary for the computing system.

In some embodiments, a computing system further includes a mechanism toprovide indications on the display screen in relation to the sensedposition of the user. In some embodiments, the indication relate totransitions of the user in relation to the operation of the computingsystem.

For example, a computing system may provide visual indications or imagesof a “log-in” process, home page configuration, and interactions whenthe computing system detects that a user has entered the computingsystem environment.

In some embodiments, a login screen may include a set of symbols, wherethe symbols may be a set of tiled windows, computing icons, or othersymbols. In some embodiments, the set of symbols may be displayedtogether with a background (referring to any other portion of thedisplay screen other than the set of symbols) that may provide motion,change in color, or other visual operations, including a star field orother type of background. Thus, a screen may initially include a versionof a home screen that has been reduced in size and placed in abackground. In some embodiments, when the computing system senses thepresence of the user using a sensing element, the background starts torespond to the user presence using visual cues. This is done by actionssuch as shimmering or coagulation of stars, waves in grass, or othervisual cues. In some embodiments, the visual cues are generated inresponse to a sensed presence of the person within a field of view ofthe 3D camera, by sound, or other sensing means.

In some embodiments, an image of the tiled windows or other symbols ofthe home screen is initially small, encouraging the user to lean towardthe system to engage with the computing system. In some embodiments,upon the user leaning into the system, the computing system may initiateengagement with the user, wherein initiation may include the symbols ofthe home page becoming closer or larger. In some embodiments, theinitiation of engagement may include performing authentication orrecognition of the user, such as conducting facial recognition forauthentication. In some embodiments, the computing system may respondback to the user asking if the correct identity has been provided forthe user. Upon the user providing acknowledgement or confirmation, suchas a gesture, verbal, key click, mouse click, or other type ofconfirmation, entry to a “Home Page” is realized by the computingsystem.

In some embodiments, in entry to the Home Page, the Home Page willbecome larger to fill the display screen. In some embodiments, the HomePage will be displayed to “fly toward” the user, thus suggesting anelement of 3D interaction. In some embodiments, this 3D effect may beachieved through a change in perspective in the case of a 2D display, orby Z-axis movement (such as movement that appears to be moving towardsthe user) in the case of a 3D display.

In some embodiments, upon entering into the Home Page, the series oficons or other symbols of the home page appear on the screen, where theicons or symbols may be shaped icons represent a combination ofapplications, files, folders, or combination thereof. In someembodiments, the icons may have 3D shapes. In some embodiments, in orderto encourage the mind of the user to perceive that the user is in a 3Dgestural space, the perspective of the 3D icons nay shift when the usershifts the user's perspective. This shift may be done in natural 3D inthe case of a 3D display, and may be achieved by parallax in the case ofa 2D display.

In some embodiments, an apparatus includes a sensing element to sense apresence or movement of a user of the apparatus, a processor, whereinoperation of the processor includes interpretation of user gestures toprovide input to the apparatus, and a light generation element togenerate a light to indicate existence of a virtual boundary of theapparatus. The computing device is to change from a first state to asecond state upon the sensing element sensing that at least a portion ofthe user is within the virtual boundary.

In some embodiments, a method includes generating a light to indicateexistence of a virtual boundary for a computing system; sensing apresence or movement of a user of the apparatus, where the sensingincludes interpretation of user gestures to provide input to thecomputing system; and changing the computing system from a first stateto a second state upon sensing that at least a portion of the user iswithin the virtual boundary.

FIG. 1 illustrates an embodiment of a computing system including amechanism to handle transitions for a user in relation to the computingsystem. In some embodiments, a computing system 100 (viewed from above)includes one or more processing elements 110 to operate the computingsystem 100. In some embodiments, the computing system includes one ormore sensing elements 120 to sense a user 150 of the system, where thesensing elements 120 may include one or more cameras or other visualsensing elements, one or more microphones or other audio sensingelements, one or more infrared or other heat sensing elements, or anyother element for sensing the presence or movement of a user. Sensingelements may include multiple different elements working together,working in sequence, or both. For example, sensing elements may includeelements that provide initial sensing, such as light or soundprojection, following by sensing for gesture detection by, for example,an ultrasonic time of flight camera or a patterned light camera.

In some embodiments, the computing system includes a light generator 130to produce an illuminated line 140. In some embodiments, the illuminatedline 140 provides a visual cue regarding a virtual boundary in space,the virtual boundary being an imaginary or virtual location in space,where action of the user 150 to pass or break through the virtualboundary or plane is interpreted as an intent to engage with thecomputing system 100. In some embodiments, the illuminated line maychange colors as the computing system transitions into different stateswith regard to the user 150.

Certain additional elements of the computing system are illustrated inFIG. 6.

FIG. 2 illustrates as embodiment of a laptop computer to sense usersincluding a transition mechanism. In some embodiments, a computingsystem is in the particular form of a laptop computer 200. In someembodiments, the computer includes one or more sensing elements (notillustrated here) that are built into or connected to the computer 200.The computer 200 may further include a display screen 210 to providedisplayed images to a user, a keyboard 220 to allow a user to provideddata inputs to the computer 200, and a palm rest 230 or other extensionof the laptop computer 200 beyond the keyboard 220.

In some embodiments, the computer 200 further includes a light generator225 to produce an illuminated line, where the illuminated line may beused to provide a visual cue for the user of a virtual boundary inspace, the virtual boundary utilized by the computing system todetermine transitions in state of the computer 200 with regard to theuser, including determining when the user wishes to engage with thecomputer 200.

FIG. 3 illustrates an embodiment of a computing system providing forengagement of a user using a transition mechanism. In some embodiments,a laptop computer 300 includes one or more sensing elements (notillustrated here) that are built into or connected to the computer 300.The computer 300 further includes a light generator 325 to produce anilluminated line, where the illuminated line may be used to provide avisual cue for a user 350 of a virtual boundary in space 345.

In some embodiments, the computer 300 senses the position of the user350, and operates to interpret the movement of a hand of the user 350through the virtual boundary 345 as a gesture indicating an intension ofthe user 350 to engage with the computer 300. In some embodiments, uponthe user passing through the virtual line or plane 345 the lightgenerated by the light generator may change, thereby providing visualfeedback to the user 350 that the user has entered an area for providinggestures to provide input to the computer 300.

FIG. 4 illustrates display screens generated by an embodiment of acomputing system to provide visual indications of transitions of stateof the computing system with regard to a user. In, some embodiments, thedisplay screens may be generated by a computing system that operates tosense a position of the user, including computing system 100 illustratedin FIG. 1. In some embodiments, a first screen 410 may be provided in afirst state, where the first state may be a state in which the presenceof a user, such as user 150 illustrate in FIG. 1, is sensed by thecomputing system, such as through use of the one or more sensingelements 120. In some embodiments, the first screen 410 may include ahome screen image, the home screen image including a set of symbols suchas icons, where the home screen image is reduced in size and surroundedby a background image. The background image may be, for example, a starfield or other image that may change in response to changes in positionof the user. In some embodiments, the background image may change inresponse to sounds detected by the computing system, such as; forexample, sounds of a user in speaking or moving in the vicinity of thecomputing system. In some embodiments, the background image may changein response to a combination of factors relating to sensing the presenceand movement of the user in the vicinity of the computing system. Thescreen 410 may include text requesting the user to move closer to thecomputing system, but this is not required in all embodiments.

In some embodiments, upon the user moving close enough to the computingsystem the computing system may act to sense the identity of the user,such as by facial recognition. In some embodiments, transition to asecond screen 420 may be provided in a second state, where the secondstate may be a state in which the computing system has recognized theidentity of the user, the screen providing visual feedback to the userthat the user has transitioned into a new state. In some embodiments,the computing system may respond back to the user asking if the rightperson has been detected, and, the user providing confirmation, entry tothe Home Page is provided.

In some embodiments, transition to a third screen 430 may provided in athird state in which the user had confirmed the recognition of the user.In some embodiments, the transition to the third screen may include theicons or symbols of the Home Page become larger and appear to movetowards the user in operation of either a 2D or 3D screen operation.

FIG. 5 is a flowchart to illustrate an embodiment of a process fortransitioning a state of a computing device to connect with a user. Insome embodiments, a computing system may be in an unconnected state 505,where such state indicates that the computing system is not engaged in asession with a user. In some embodiments, if the computing systemdetects the presence of a user in sensing range of the computing system510 (where being in sensing range includes being in range of thecomputing system viewing, hearing, or otherwise sensing the user), thenthe computing system provides a visual clue in a display to indicate thesensing of the user by the computing system 515, which a mechanism mayinclude the use of display 410 illustrated in FIG. 4 or a similardisplay. In some embodiments, there may be determination whether theuser is close enough to the computing system to indicate intent toengage the computing system 520. If so, the computing system may attemptto detect the identity of the user 525, such as by facial recognition.

In some embodiments, if the user is recognized, the computing system mayprovide an indication to the user indicating that the user is recognized530, where a mechanism to indicate the transition may include the screentransition illustrated as display 420 in FIG. 4 or a similar display.

In some embodiments, the computing system may request or wait for anacknowledgement from the user 535. Upon receiving acknowledgement fromthe user or otherwise completing the connection process, the computingsystem may provide an indication to the user that the state of thecomputing system has changed to connected, and a computing session withthe user is commenced 540. In some embodiments, a mechanism to indicatethe transition may include the screen transition illustrated as display430 in FIG. 4 or a similar display.

FIG. 6 is a flowchart to illustrate an embodiment of a process fortransitions of a state of a computing system in connection withrecognition of gestures by a user. In some embodiments, a computingsystem may have commenced a session with a user 600, such as illustratedin FIG. 5. In some embodiments, the computing system may use atransition mechanism to determine a location of a virtual boundary for auser, where the location of the virtual boundary may vary with user andcontext. In some embodiments, the computing system may generate a light,such as an illuminated line, to indicate the virtual boundary forengaging with the computing system 605, such as illustrate asilluminated line 140 generated by light generator 130 in FIG. 1. In someembodiments, the computing system may be in a waiting state, and thelight may be produced in a first color (such as blue in this example)610. In some embodiments, the computing system may detect whether theuser has reached past the virtual boundary 615, such as by sensing thepresence and movement of the user using sensing elements 120 illustratedin FIG. 1.

In some embodiments, if the user has been detected as having crossed thevirtual boundary (such as the hands of the user being closer to thecomputing system than the virtual boundary line), the computing systemmay transition to a state for receiving gesture inputs from the user,where a mechanism to indicate the transition may include the lightindicating the virtual boundary changing to a second color (such aswhite) 620.

In some embodiments, the computing system may then determine whethergesture movement is detected 625. If gesture movement is detected, thecomputing system may proceed with a gesture recognition process 630,which may include the use of data from a gesture data library 635, whichmay reside in memory in the computing device or may be otherwiseaccessed by the computing device.

If a gesture if the user is recognized 640, the computing system mayperform a function in response to the input 650, and return to receiveadditional gestures if the user is within the virtual boundary forengaging with the computing system 615. In some embodiments, if thegesture is not recognized, the computing system may transition into anerror state, where a mechanism to indicate the error state may includethe light indicating the virtual boundary changing to a third color(such as red) 645, with the system return to receive additional gesturesif the user is within the virtual boundary for engaging with thecomputing system 615.

FIG. 7 is a block diagram to illustrate an embodiment a computing systemincluding mechanism to handle transitions for a user in relation to thecomputing system. Computing system 700 represents any computing deviceor system utilizing user sensing, including a mobile computing device,such as a laptop computer, computing tablet, a mobile phone orsmartphone, a wireless-enabled e-reader, or other wireless mobiledevice. It will be understood that certain of the components are showngenerally, and not all components of such a computing system are shownin computing system 700.

Computing system 700 includes processor 710, which performs the primaryprocessing operations of computing system 700. Processor 710 can includeone or more physical devices, such as microprocessors, applicationprocessors, microcontrollers, programmable logic devices, or otherprocessing means. The processing operations performed by processor 710include the execution of an operating platform or operating system onwhich applications, device functions, or both are executed. Theprocessing operations include, for example, operations related to I/O(input/output) with a human user or with other devices, operationsrelated to power management, and operations related to connectingcomputing system 700 to another system or device. The processingoperations may also include operations related to audio I/O, displayI/O, or both. Processors 710 may include one or more graphics processingunits (GPUs), including a GPU used for general-purpose computing ongraphics processing units (GPGPU).

In some embodiments, computing system 700 includes audio subsystem 720,which represents hardware (such as audio hardware and audio circuits)and software (such as drivers and codecs) components associated withproviding audio functions to the computing system. Audio functions caninclude speaker output, headphone output, or both, as well as microphoneinput. Devices for such functions can be integrated into computingsystem 700, or connected to computing system 700. In some embodiments, auser interacts with computing system 700 by providing audio commandsthat are received and processed by processor 710.

Display subsystem 730 represents hardware (for example, display devices)and software (for example, drivers) components that provide a visualdisplay, a tactile display, or combination of displays for a user tointeract with the computing system 700. Display subsystem 730 includesdisplay interface 732, which includes the particular screen or hardwaredevice used to provide a display to a user. In one embodiment, displayinterface 732 includes logic separate from processor 710 to perform atleast some processing related to the display. In one embodiment, displaysubsystem 730 includes a touchscreen device that provides both outputand input to a user.

I/O controller 740 represents hardware devices and software componentsrelated to interaction with a user. I/O controller 740 can operate tomanage hardware that is part of audio subsystem 720 and hardware that ispart of the display subsystem 730. Additionally, I/O controller 740illustrates a connection point for additional devices that connect tocomputing system 700 through which a user might interact with thesystem. For example, devices that can be attached to computing system700 might include microphone devices, speaker or stereo systems, videosystems or other display device, keyboard or keypad devices, or otherI/O devices for use with specific applications such as card readers orother devices.

As mentioned above, I/O controller 740 can interact with audio subsystem720, display subsystem 730, or both. For example, input through amicrophone or other audio device can provide input or commands for oneor more applications or functions of computing system 700. Additionally,audio output can be provided instead of or in addition to displayoutput. In another example, if display subsystem includes a touchscreen,the display device also acts as an input device, which can be at leastpartially managed by I/O controller 740. There can also be additionalbuttons or switches on computing system 700 to provide I/O functionsmanaged by I/O controller 740.

In one embodiment, I/O controller 740 manages devices such asaccelerometers, cameras, light sensors or other environmental sensors,or other hardware that can be included in computing system 700. Theinput can be part of direct user interaction, as well as providingenvironmental input to the system to influence its operations (such asfiltering for noise, adjusting displays for brightness detection,applying a flash for a camera, or other features).

In one embodiment, computing system 700 includes power management 750that manages battery power usage, charging of the battery, and featuresrelated to power saving operation. Memory subsystem 760 includes memorydevices for storing information in computing system 700. Memory caninclude nonvolatile (state does not change if power to the memory deviceis interrupted) memory devices and volatile (state is indeterminate ifpower to the memory device is interrupted) memory devices. Memory 760can store application data, user data, music, photos, documents, orother data, as well as system data (whether long-term or temporary)related to the execution of the applications and functions of system700. In particular, memory may include gesture detection data 762 foruse in detecting and interpreting gestures by a user of the computingsystem 700.

In some embodiments, computing system 700 includes one or more usersensing elements 790 to sense presence and motion, wherein may includeone or more cameras or other visual sensing elements, one or moremicrophones or other audio sensing elements, one or more infrared orother heat sensing elements, or any other element for sensing thepresence or movement of a user.

In some embodiments, computing system 700 includes a light generationelement 795 to generate an illuminated line to indicate a location of avirtual boundary for engagement with the computing system 700.

Connectivity 770 includes hardware devices (such as wireless and wiredconnectors and communication hardware) and software components (such asdrivers and protocol stacks) to enable computing system 700 tocommunicate with external devices. The computing system could includeseparate devices, such as other computing devices, wireless accesspoints or base stations, as well as peripherals such as headsets,printers, or other devices.

Connectivity 770 can include multiple different types of connectivity.To generalize, computing system 700 is illustrated with cellularconnectivity 772 and wireless connectivity 774. Cellular connectivity772 refers generally to cellular network connectivity provided bywireless carriers, such as provided via GSM (global system for mobilecommunications) or variations or derivatives, CDMA (code divisionmultiple access) or variations or derivatives, TDM (time divisionmultiplexing) or variations or derivatives, or other cellular servicestandards. Wireless connectivity 774 refers to wireless connectivitythat is not cellular, and can include personal area networks (such asBluetooth), local area networks (such as WiFi), wide area networks (suchas WiMax), or other wireless communication. Connectivity 770 may includean omnidirectional or directional antenna for transmission of data,reception of data, or both.

Peripheral connections 780 include hardware interfaces and connectors,as well as software components (for example, drivers and protocolstacks) to make peripheral connections. It will be understood thatcomputing system 700 could both be a peripheral device (“to” 782) toother computing devices, as well as have peripheral devices (“from” 784)connected to it. Computing system 700 commonly has a “docking” connectorto connect to other computing devices for purposes such as managing(such as downloading, uploading, changing, and synchronizing) content oncomputing system 700. Additionally, a docking connector can allowcomputing system 700 to connect to certain peripherals that allowcomputing system 700 to control content output, for example, toaudiovisual or other systems.

In addition to a proprietary docking connector or other proprietaryconnection hardware, computing system 700 can make peripheralconnections 780 via common or standards-based connectors. Common typescan include a Universal Serial Bus (USB) connector (which can includeany of a number of different hardware interfaces), DisplayPort includingMiniDisplayPort (MDP), High Definition Multimedia Interface (HDMI),Firewire, or other type.

FIG. 8 illustrates an embodiment of a computing system for perceptualcomputing. The computing system may include a computer, server, gameconsole, or other computing apparatus. In this illustration, certainstandard and well-known components that are not germane to the presentdescription are not shown. Under some embodiments, the computing system800 comprises an interconnect or crossbar 805 or other communicationmeans for transmission of data. The computing system 800 may include aprocessing means such as one or more processors 810 coupled with theinterconnect 805 for processing information. The processors 810 maycomprise one or more physical processors and one or more logicalprocessors. The interconnect 805 is illustrated as a single interconnectfor simplicity, but may represent multiple different interconnects orbuses and the component connections to such interconnects may vary. Theinterconnect 805 shown in FIG. 8 is an abstraction that represents anyone or more separate physical buses, point-to-point connections, or bothconnected by appropriate bridges, adapters, or controllers.

Processing by the one or more processors include processing forperceptual computing 811, where such processing includes sensing andinterpretation of gestures in relation to a virtual boundary of thecomputing system.

In some embodiments, the computing system 800 further comprises a randomaccess memory (RAM) or other dynamic storage device or element as a mainmemory 812 for storing information and instructions to be executed bythe processors 810. RAM memory includes dynamic random access memory(DRAM), which requires refreshing of memory contents, and static randomaccess memory (SRAM), which does not require refreshing contents, but atincreased cost. In some embodiments, main memory may include activestorage of applications including a browser application for using innetwork browsing activities by a user of the computing system. DRAMmemory may include synchronous dynamic random access memory (SDRAM),which includes a clock signal to control signals, and extended data-outdynamic random access memory (EDO DRAM). In some embodiments, memory ofthe system may include certain registers or other special purposememory.

The computing system 800 also may comprise a read only memory (ROM) 816or other static storage device for storing static information andinstructions for the processors 810. The computing system 800 mayinclude one or more non-volatile memory elements 818 for the storage ofcertain elements.

In some embodiments, the computing system 800 includes one or more inputdevices 830, where the input devices include one or more of a keyboard,mouse, touch pad, voice command recognition, gesture recognition, orother device for providing an input to a computing system.

The computing system 800 may also be coupled via the interconnect 805 toan output display 840. In some embodiments, the display 840 may includea liquid crystal display (LCD) or any other display technology, fordisplaying information or content to a user. In some environments, thedisplay 840 may include a touch-screen that is also utilized as at leasta part of an input device. In some environments, the display 840 may beor may include an audio device, such as a speaker for providing audioinformation.

One or more transmitters or receivers 845 may also be coupled to theinterconnect 805. In some embodiments, the computing system 800 mayinclude one or more ports 850 for the reception or transmission of data.The computing system 800 may further include one or more omnidirectionalor directional antennas 855 for the reception of data via radio signals.

The computing system 800 may also comprise a power device or system 860,which may comprise a power supply, a battery, a solar cell, a fuel cell,or other system or device for providing or generating power. The powerprovided by the power device or system 860 may be distributed asrequired to elements of the computing system 800.

In the description above, for the purposes of explanation, numerousspecific details are set forth in order to provide a thoroughunderstanding of the present invention. It will be apparent, however, toone skilled in the art that the present invention may be practicedwithout some of these specific details. In other instances, well-knownstructures and devices are shown in block diagram form. There may beintermediate structure between illustrated components. The componentsdescribed or illustrated herein may have additional inputs or outputs,which are not illustrated or described.

Various embodiments may include various processes. These processes maybe performed by hardware components or may be embodied in computerprogram or machine-executable instructions, which may be used to cause ageneral-purpose or special-purpose processor or logic circuitsprogrammed with the instructions to perform the processes.Alternatively, the processes may be performed by a combination ofhardware and software.

Portions of various embodiments may be provided as a computer programproduct, which may include a computer-readable medium having storedthereon computer program instructions, which may be used to program acomputer (or other electronic devices) for execution by one or moreprocessors to perform a process according to certain embodiments. Thecomputer-readable medium may include, but is not limited to, floppydiskettes, optical disks, compact disk read-only memory (CD-ROM), andmagneto-optical disks, read-only memory (ROM), random access memory(RAM), erasable programmable read-only memory (EPROM),electrically-erasable programmable read-only memory (EEPROM), magnet oroptical cards, flash memory, or other type of computer-readable mediumsuitable for storing electronic instructions. Moreover, embodiments mayalso be downloaded as a computer program product, wherein the programmay be transferred from a remote computer to a requesting computer.

Many of the methods are described in their most basic form, butprocesses can be added to or deleted from any of the methods andinformation can be added or subtracted from any of the describedmessages without departing from the basic scope of the presentinvention. It will be apparent to those skilled in the art that manyfurther modifications and adaptations can be made. The particularembodiments are not provided to limit the invention but to illustrateit. The scope of the embodiments of the present invention is not to bedetermined by the specific examples provided above but only by theclaims below.

If it is said that an element “A” is coupled to or with element “B,”element A may be directly coupled to element B or be indirectly coupledthrough, for example, element C. When the specification or claims statethat a component, feature, structure, process, or characteristic A“causes” a component, feature, structure, process, or characteristic B,it means that “A” is at least a partial cause of “B” but that there mayalso be at least one other component, feature, structure, process, orcharacteristic that assists in causing “B.” If the specificationindicates that a component, feature, structure, process, orcharacteristic “may”, “might”, or “could” be included, that particularcomponent, feature, structure, process, or characteristic is notrequired to be included. If the specification or claim refers to “a” or“an” element, this does not mean there is only one of the describedelements.

An embodiment is an implementation or example of the present invention.Reference in the specification to “an embodiment,” “one embodiment,”“some embodiments,” or “other embodiments” means that a particularfeature, structure, or characteristic described in connection with theembodiments is included in at least some embodiments, but notnecessarily all embodiments. The various appearances of “an embodiment,”“one embodiment,” or “some embodiments” are not necessarily allreferring to the same embodiments. It should be appreciated that in theforegoing description of exemplary embodiments of the present invention,various features are sometimes grouped together in a single embodiment,figure, or description thereof for the purpose of streamlining thedisclosure and aiding in the understanding of one or more of the variousinventive aspects. This method of disclosure, however, is not to beinterpreted as reflecting an intention that the claimed inventionrequires more features than are expressly recited in each claim. Rather,as the following claims reflect, inventive aspects lie in less than allfeatures of a single foregoing disclosed embodiment. Thus, the claimsare hereby expressly incorporated into this description, with each claimstanding on its own as a separate embodiment of this invention.

What is claimed is:
 1. An apparatus comprising: a sensing element tosense a presence or movement of a user of the apparatus; a processor,wherein operation of the processor includes interpretation of usergestures to provide input to the apparatus; and a light generationelement to generate a light to indicate existence of a virtual boundaryof the apparatus; wherein the apparatus is to establish a location ofthe virtual boundary for the user, establishing the location of thevirtual boundary for the user including establishing the location basedat least in part on one or more of an identity of the user and a contextof operation; and wherein the apparatus is to change from a first stateto a second state upon the sensing element sensing that at least aportion of the user is within the virtual boundary.
 2. The apparatus ofclaim 1, wherein the virtual boundary is an imaginary line or plane inspace at a certain location.
 3. The apparatus of claim 2, where thelocation of the virtual boundary is to be related to a location of theapparatus or to a location of the user.
 4. The apparatus of claim 2,wherein the light is to indicate the location of the virtual boundary.5. The apparatus of claim 2, where the light and the virtual boundaryare to be at different locations.
 6. The apparatus of claim 1, whereinthe first state is a waiting state and the second state is a state forreceiving inputs from the user by detecting gestures of the user.
 7. Theapparatus of claim 1, wherein the light includes an illuminated line. 8.The apparatus of claim 1, wherein the light generation element is toproduce a different color of light for each of a plurality of states. 9.The apparatus of claim 1, further comprising a library of gesture data,the processor to utilize the library of gesture data in interpretationof user gestures.
 10. The apparatus of claim 1, further comprising adisplay screen, wherein the apparatus is to present a plurality ofimages on the display screen to indicate establishment of a connectedstate for the apparatus, the presentation of the plurality of imagesincluding a change of an aspect of the display screen based on sensedpresence or movement of the user.
 11. A method comprising: establishinga location of a virtual boundary of a computing system for a user,wherein establishing the location of the virtual boundary for the userincludes establishing the location based at least in part on one or moreof an identity of the user and a context of operation; generating alight to indicate existence of the virtual boundary for the computingsystem; sensing a presence or movement of the user, wherein the sensingincludes interpretation of user gestures to provide input to thecomputing system; and changing the computing system from a first stateto a second state upon sensing that at least a portion of the user iswithin the virtual boundary.
 12. The method of claim 11, wherein thevirtual boundary is an imaginary line or plane in space at a certainlocation in relation to the computing system or the user.
 13. The methodof claim 12, wherein generating the light includes generating a lightthat indicates the location of the virtual boundary.
 14. The method ofclaim 11, wherein the first state is a waiting state and the secondstate is a state for receiving inputs from the user by detectinggestures of the user.
 15. The method of claim 11, wherein generating thelight includes generating an illuminated line.
 16. The method of claim11, wherein generating the light includes generating a different colorof light for each of a plurality of states.
 17. The method of claim 11,further comprising displaying a plurality of images on a display screenfor establishing a connected state for the apparatus, the presentationof the plurality of images including changing an aspect of the displayscreen based on sensed presence or movement of the user.
 18. Anon-transitory computer-readable storage medium having stored thereondata representing sequences of instructions that, when executed by aprocessor, cause the processor to perform operations comprising:establishing a location of a virtual boundary of a computing system fora user, wherein establishing the location of a virtual boundary for theuser includes establishing the location based at least in part on one ormore of an identity of the user and a context of operation; generating alight to indicate existence of the virtual boundary for the computingsystem; sensing a presence or movement of the user, wherein the sensingincludes interpretation of user gestures to provide input to thecomputing system; and changing the computing system from a waiting stateto a state for receiving inputs from the user by detecting gestures ofthe user upon sensing that at least a portion of the user is within thevirtual boundary.
 19. The medium of claim 18, wherein the virtualboundary is an imaginary line or plane in space at a certain location inrelation to the computing system or the user, wherein the generating thelight includes generating a light that indicates the location of thevirtual boundary.